Stratification in the Preferential Attachment Network 
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We study structural properties of trees grown by preferential attachment. In this mechanism, 
nodes are added sequentially and attached to existing nodes at a rate that is strictly proportional 
to the degree. We classify nodes by their depth n, defined as the distance from the root of the 
tree, and find that the network is strongly stratified 
with degree k at depth n has a power-law tail 
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Most notably, the distribution of nodes 
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The exponent grows linearly with 



depth, 7(n) = 2+ , where the brackets denote an average over all nodes. Therefore, nodes that 
are closer to the root are better connected, and moreover, the degree distribution strongly varies 
with depth. Similarly, the in-component size distribution has a power-law tail and the characteristic 
exponent grows linearly with depth. Qualitatively, these behaviors extend to a class of networks 
that grow by a redirection mechanism. 
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I. INTRODUCTION 

Unlike the ordered crystalline structure of solid-state 
matter a wide array of natural and man-made net- 
works ranging from chemical reaction pathways and so- 
cial groups to the Internet and airline routes have a 
strongly heterogeneous structure 0, d, 01 • The connectiv- 
ity of an element in such complex networks varies across 
multiple scales: most of the nodes have a very small num- 
ber of connections, but there is also a small number of 
highly connected hubs. 

The degree distribution measures the connectivity in 
the network and is widely used to characterize the struc- 
ture of complex networks. This distribution uniformly 
samples all nodes in the network. Yet, given the highly 
heterogeneous structure of complex networks, it is plau- 
sible that different subsets of nodes have very different 
structural characteristics. In this study, we show that the 
degree distribution strongly varies in a given network. 

We focus on the basic preferential attachment mecha- 
nism [5, 6] which provides a useful model of growing net- 
works [3, Q . The preferential attachment network, where 
nodes are added sequentially and attached to existing 
nodes at a rate proportional to the degree, demonstrates 
how a "rich-gets-richer" mechanism generates networks 
with highly connected nodes and with a broad distribu- 
tion of connectivities. 

For the preferential attachment network, which has a 
tree topology, it is natural [§, [l3| to classify nodes by 
their depth n, defined as the distance from the root. This 
depth representation divides the network into layers: the 
first layer includes nodes with depth n ~ I, the second 
layer includes nodes with depth n = 2, etc. Our main 
result is that the distribution Z^"-* of nodes with degree 
k at the nth layer has an algebraic tail with a depth- 
dependent exponent. 
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Interestingly, the exponent 7 grows linearly with depth, 
and thus, nodes that are closer to the root tend to be 
better connected. The degree distribution ([T|) matches 
the total degree distribution, /^°*^' ~ fc^"^, only at the 
average depth, n — (n). The tail of the degree distri- 
bution is overpopulated with respect to the total distri- 
bution below the average depth and conversely, the tail 
is underpopulated above the average depth. Therefore, 
the network is stratified. In particular, the structure of 
the network changes with the depth because the degree 
distribution is not uniform across the network. 

This qualitative behavior extends to other structural 
features of the network. In particular, the in-component 
size distribution that measures the total number of nodes 
that emanate from a given node has a very similar be- 
havior as in any layer the distribution has an algebraic 
tail and the corresponding exponent grows linearly with 
depth. Furthermore, the tail of the in-component size 
distribution is shallow below the average depth but steep 
above the average depth. We generalize these results to 
the broader class of redirection networks, and find similar 
network structures. 

The rest of this paper is organized as follows. We de- 
scribe the preferential attachment network and discuss 
the distribution of depth in section II. We analyze the 
depth dependence of the degree distribution and the in- 
component size distribution in sections III and IV, re- 
spectively. We briefly discuss redirection networks in sec- 
tion V and conclude in section VI. The correction to the 
leading asymptotic behavior in large but finite networks 
is derived in Appendix A. 



II. THE PREFERENTIAL ATTACHMENT 
NETWORK 

In the preferential attachment model of network 
ifrowth, nodes are added one at a time. Each new node is 
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FIG. 1: Illustration of the redirection process. The new node, 
indicated by a bullet, links with equal probabilities to a ran- 
domly selected node or to its parent. 



FIG. 2: Illustration of the layer structure, 
figure are the first three layers. 
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linked to a target node that is selected with probability 
that is strictly proportional to the degree. This attach- 
ment mechanism favors strongly connected nodes over 
weakly connected ones. We assume that initially there 
is a single node, the root. Since each attachment event 
adds one node and one link, the network maintains a tree 
topology. 

We use link redirection [9| to emulate preferential at- 
tachment. In the redirection process, following the addi- 
tion of a new node, an existing node is selected at ran- 
dom. With probability ^, the new node links to this 
randomly selected node, and with equal probability ^, 
the new node links to the parent of the selected node, 
as in figure 1. A node with degree k has one outgoing 
link and fc — 1 incoming links, and the total probability 
Pfc of attachment to such a node includes two contribu- 
tions: the probability of a direct link is 2^ where N 
is the total number of nodes while the probability of a 
redirected link is Thus, the total attachment proba- 
bility Pfc = 2^ is strictly proportional to the degree, and 
this link redirection process is equivalent to preferential 
attachment. Redirection does not explicitly involve the 
degree of a node, and is therefore convenient for both 
theoretical analysis and numerical simulation ITl| . 

Let us label the nodes in the network by their depth n, 
defined as the distance from the root. With this defini- 
tion, nodes are grouped by layers: the first layer consists 
of nodes with n — 1, the second layer consists of nodes 
with n = 2, etc, as illustrated in figure 2. As a prelimi- 
nary step, we evaluate M„(iV), the expected number of 
nodes at the nth layer in a network with N nodes. This 
quantity obeys the difference equation 



M„(7V + l)-M„(iV) = 



M„,i(jV) + M„(jV) 
27V 



(2) 



The boundary condition is Mq ~ 1 because there is a 
single root. The first gain term on the right hand side ac- 
counts for direct links and the second term for redirected 
links. Also, the right hand side is inversely proportional 
to the total number of nodes. This difference equation 
can be converted into a differential equation when the 
network is large, N ^ 1, 



dN 



Mn-1+M„ 

2N 



(3) 



Henceforth, the TV-dependence is implicit. The num- 
ber of nodes at the first layer, Afi ~ N^^'^, fol- 
lows from dMi/dN ^ Mi/{2N) Q. In general, the 
transformation M„ = MiTUn reduces equation ([3]) to 
dmn/dN = TO„_i/(2iV) with the boundary condition 
TOi — 1. Solving this latter equation recursively 
yields m2 — -^InA^, 7713 — ^ (^InA^) , and in general, 
IniVV ^. Therefore, the distribution of 
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depth is 
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Accordingly, the distribution of the variable n — 1 is 
Poissonian and is fully characterized by the average that 
grows logarithmically with the total number of nodes. 
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Furthermore, the variance, fi^ ~ ((n — 1)^) — (n — 1)^, 
equals the average, ~ i In A^. 

In principle, the Poisson depth distribution ^ is Gaus- 
sian in the vicinity of the average depth. Specifically, the 
the variable ^ — [{n — 1) — (n — l)]/a obeys Gaussian 
statistics. In practice, since the depth and the variance 
both grow logarithmically with the network size, statis- 
tics of the depth are not fully captured by the Gaussian 
distribution even in very large networks. 

We measure the depth in units of the average using the 
normalized depth 



y 



n- 1 
(n-1) 
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The average number of nodes with normalized depth y 
grows as a power-law with the total number of nodes. 



1 + y — ylny 



(7) 



This result is obtained by substituting n — 1 = ^InN into 
(|3]) and then evaluating the quantity In M„ ~ In A^ us- 
ing the Stirling formula, Inn! ~ nlnn — n. As expected, 
the total number of nodes at the average depth is propor- 
tional to the system size, v{l) = 1, and the total number 
of nodes at the first layer is consistent with (H]), i^{0) = i. 
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In general, the exponent v that characterizes the popu- 
lation of nodes at a given depth is continuously varying, 
and in particular, this exponent vanishes at a nontrivial 
maximal depth, ?/max = 3.59112, specified as the root of 
the equation 1 + j/max = 2/max Ini/max- Therefore, there 
are no nodes with depth larger than this maximal depth, 
< y < ymax- 



III. THE DEGREE DISTRIBUTION 



We now discuss the unnormalized degree distribution, 

in) 

, defined as the average number of nodes with depth 
n and degree k. We begin with the first layer, n = 1, 
where the quantity pj^^'^ obeys the rate equation 



dF, 
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(fc - l)fii\ - kF, 
2N 



dN 



Mq + Mi 
2N 
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Throughout this study, we assume that the network is 
large and treat iV as a continuous variable. In other 
words, we use rate equations as in ([3]) rather than differ- 
ence equations as in ([2]) . The first two gain terms on the 
right hand side account for augmentation in the degree of 
an existing node due to attachment, and the correspond- 
ing rate of attachment to nodes with degree k equals 
the attachment probability Pk = The last two gain 
terms, accounting respectively for redirected links and 
direct links, correspond to the new nodes. 

We now introduce the degree distribution f\^\ the 
fraction first layer nodes with degree k, defined by 
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This distribution is normalized. 



l^k Jk 



(9) 



1. With the 



definition the evolution equation ([5]) becomes 
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Mq + Ml 
2N 
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In writing this equation, we kept the rate of change of the 
total number of nodes in the first layer dMi/dN given by 
^ , but neglected the sub-dominant TV-dependence of the 
normalized degree distribution dj^^ /dN . The number of 
nodes at the zeroth layer, Mq = 1, is negligible compared 
with the number of nodes at the first layer, Mq <C Mi, 



and as a result, the degree distribution /j. 
simple recursion equation 



(1) 



obeys the 



(fc 



(fc- 
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Hence, the degree distribution is /^/^ = T^'ira'Fi 
k = 1,2,3, and in general, this quantity is remarkably 
simple, 



for 




FIG. 3: The degree distribution at different depths. Shown is 
the closed form expression (|14|l for five, equally-spaced, values 
of the normalized depth y defined in (|6]). 



This distribution is properly normalized, /^^^ = 1. 
Interestingly, the tail of the normalized degree distri- 
bution, Z^^'' ~ k^'^ is overpopulated with respect to 
that of the total degree distribution, /^°*^' ~ k~^ d, 
0, Q. Nevertheless, the expected number of nodes 

■ " . ■ -(1) An/2h~2 



with degree k at the first layer, Ff 



N^/^k- 



mains smaller than the total number of nodes with 
degree k, ^ Nk~^, because the maximal degree 

in the network is bounded, k ^ N^^^. The maxi- 
mal degree in the network, /cmax N^^'^, is esti- 
mated by equating the cumulative degree distribution 
Qk = E,>fe ~ Nk-^ to one, Qk 1. Equation ^ 



clearly shows that nodes at the first layer tend to be much 
more connected compared with the rest of the network. 

(n) 

The equation governing Fj^ , the average number of 
nodes with degree k at the nth layer, is given by a 
straightforward generalization of ^ , 



dF, 



(n) 



[k 



kF, 
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M, 



dN 



2N 



2N 
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Following the steps leading to PH)) . the degree distribu- 



tion, fp, defined as in ©, F^'> = M„/^"\ obeys the 
recursion equation 



(fc+i+y)4"' = (fc-i)/n + (i+2/)4 



(13) 



with the shorthand notation y — Mn-i/Mn- The pa- 
rameter y is equivalent to the normalized depth de- 
fined in ([6]) . The degree distribution follows immediately 
from the recursion equation (|13p . First, the fraction of 



(10) leafs is /| 



(n) 



An) I An) 
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(l + y)(2 + y). Second, using the ratio 

(fc — l)(/e -I- 1 -I- y) and the following prop- 
erty of the Gamma function, r(a; -I- l)/r(a::) — x, we ex- 
press the degree distribution in a closed form in terms of 
the Gamma function. 
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r{2 + y)T{k) 
Tik + 2 + y)- 



(14) 



i 



Therefore, there is a family of degree distributions, pa- 
rameterized by the normahzed depth y. From the well- 
known asymptotic behavior of the ratio of Gamma func- 
tions, limx^oo[x'^^{x)/T{x + a)] = 1, we find that the 
degree distribution has a power-law tail, 
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At 



-7(n) 



for k ^ 1. The characteristic exponent 7 = 2 
linearly with depth 



-fin) = 2 + 



1 



(15) 



y grows 



(16) 



and the prefactor is A = (1 + y) r(2 + y). The power- 
law behavior psp strictly holds only for infinitely large 
networks. The appendix describes the correction to this 
leading asymptotic behavior in large but finite networks. 

As shown in figure 3, the degree distribution is not 
uniform across the network and the characteristic ex- 
ponent "f{n) increases linearly with depth n. There- 
fore, nodes that are closer to the root tend to have a 
larger number of connections. The tail of the degree 
distribution is overpopulated with respect to the total 
degree distribution below the average depth as 7 < 3 
for n < (n). Similarly, the tail is underpopulated with 
respect to the total degree distribution above the aver- 
age depth, 7 > 3 for n > (n). The degree distribu- 
tion at the average depth equals the total degree distri- 
bution /^^"^^ = = 4/[fc(fc + l){k + 2)] because the 
depth distribution ^ gradually narrows around the av- 
erage depth ^ as the network grows. Nevertheless, there 
is still an appreciable number of nodes at depths other 
than the average, as indicated by the power-law growth 
in ([7]). Finally, we note that since the depth is bounded 
by the maximum value j/max = 3.59112, the characteristic 
exponent has a nontrivial upper bound, 2 < 7 < 5.59112. 



IV. THE IN-COMPONENT SIZE 
DISTRIBUTION 

Each node is in itself a root of the sub-tree that em- 
anates from it. This sub-tree is termed the in-component 
of the node and we denote by s the size of the in- 
component. We note that the size of the in-component 
is at least as large as the degree of the node: s > k. The 
minimal size s = 1 corresponds to dangling nodes with- 

(n) 

out descendants. Let Gs be the average number of nth 
layer nodes with in-components of size s. This quantity 
satisfies the rate equation 



dG 



(n) 



dN 



-I)GTJ,-{s-^ )G 
N 



(«) 



Mn-i+M„ 
2N 



With probability a node in an in-component of size 
s is selected at random following the addition of a new 
node, and all such events, with the exception of redirec- 
tion away from the root of the sub-tree, result in attach- 
ment of an additional node to the in-component. Since 




FIG. 4: The in-component size distribution at different 
depths. Shown is the closed form expression (|18|) for y = 
0,1/2,1,3/2,2. 



redirection away from the root of the sub-tree occurs with 
probability 2^ , the probability of attaching an additional 

node to the in-component equals ^—jf^- Hence, the first 
two terms on the right hand side. The last two terms are 
as in (fT2l). 



The normalized distribution g, 

egree s and depth n, 
the recursion equation 



(n) 



of nodes with in- 



degree s and depth n, defined by Gs = Mn gl , obeys 
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1 + y . 



(17) 



This equation is very similar in structure to the equa- 
tion (|13p governing the degree distribution. Dan- 
gling nodes have s = k = 1 and there- 
fore, gj"'' — /I"-* = (1 + y){2 + y). Using the ra- 
tio ^^"Vss'-i = (y ~ 3/2)/(s + y/2), we obtain the in- 
component size distribution in closed form 



9. 



(n) 



i + yr(2 + |) r(.-i) 



y ri 



1 



(18) 



Again, there is a family of distributions that is governed 
by y. Therefore, the in-component size distribution has 
a power-law tail 



(19) 



and the characteristic exponent varies continuously with 
depth, l3={3 + y)/2 or 



(20) 



, 3 1 n-1 

Bin) = - + -. 

'^^ ^ 2 2 n - 1 



The prefactor in ((T9|) is B = (1 + y)r(l + y/2)/V4^. 

The in-component size distribution is very similar to 
the degree distribution (Figure 4). Nodes that are closer 
to the root tend to have larger in-components. The 
tail of the in-component size distribution is overpopu- 
lated below the average depth, fi < 2 when n < (n), 
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while the tail is underpopulated above the average depth, 
(3 > 2 for n > {n). The in-component size distri- 
bution matches the total distribution at the average 



2 [4s^ - Moreover, the in- 



depth, Ci^"^^ = G\°^^^ 
component size distribution is steepest, /3max — 4.29556, 
at the maximal depth j/max = 5.59112. 

For completeness, we also quote the in-component size 
distribution in the first layer. 



1 ri 



4^ r(s + i) 



(21) 



and the corresponding tail, g. 



(1) 



-3/2 



V. REDIRECTION NETWORKS 

We briefly discuss the broader class of redirection net- 
works |9j]. This family of networks is also grown by se- 
quential addition of nodes. Subsequent to the addition 
of a new node, one existing node is selected at random. 
With the redirection probability r, the new node attaches 
to the parent of the randomly selected node while with 
the complementary probability 1 — r, the new nodes at- 
taches to the randomly selected node itself. Redirec- 
tion networks are therefore parameterized by the redi- 
rection probability r. The probability Pk of attachment 
to a node of degree k varies linearly with the degree, 
Pk — {k ~ \-)r + {1 — r) or equivalently. 



Pk 



kr + l-2r 
N ■ 



(22) 



As mentioned above, the special case r = 1/2 yields the 
preferential attachment network. The limiting case r — 
corresponds to the random recursive tree where the at- 
tachment probability is uniform [H, [13, [ll [H, [H, [13, 
[11. 

The depth distribution obeys the following generaliza- 
tion of © 



dN 



(1 -r)Af„_i +rM„ 
N 



(23) 



Here, the first gain term accounts for direct links and the 
second term, for redirected links. The depth distribution 
is always Poissonian 



[(l-r) IniV]' 



(24) 



and fully characterized by the average 
{n- 1) ~ (l-r) In TV. 

The degree distribution is obtained by replacing the at- 
tachment probability Pk = C2) with ([22|). We skip 
the straightforward derivation of the degree distribution 
and merely quote the final result. 



Jk 



(n) _ r + y-ry T ( 



l-\-r-^y—ry 



i + y-ry r(i^) T{k+'-+^)' 



(25) 



The parameter y is the same normalized depth of ([6]) with 
the appropriate average {n— 1) ~ {^ — t) InN. Therefore, 
the degree distribution decays algebraically as in (fTSjl 
with the exponent 7 = 2 + [(1 — r)y]/r or equivalently 



7(n) 



The in-component size distribution 
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y — ry T{2 + y — ry) T{s — r) 
I + y — ry T{1 — r) T{s + 1 + y — ry) 



(26) 
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is obtained by replacing the attachment probability ^ 
in pT|) with As expected, this distribution decays 

algebraically as in with the exponent 



P{n) = 1 + r + (1 - r)- 



1 



1> 



(28) 



There is no substantive change in the behaviors of the 
degree distribution and the in-component size distribu- 
tion. These distributions are characterized by power-law 
tails that become steeper with increasing depth, so that 
the further from the root a node is, the less likely that 
the node is highly connected. Generally, the degree dis- 
tribution is non-uniform throughout the network. 



VI. CONCLUSIONS 

In conclusion, we studied how the degree distribution 
depends on depth, defined as the distance from the root, 
in the preferential attachment network and found that 
the network is strongly stratified. There is a family of de- 
gree distributions that is parameterized by the depth and 
the total degree distribution is a special case that corre- 
sponds to the behavior at the average depth. The degree 
distribution has a shallow power-law tail below the aver- 
age depth and a steep tail above the average depth as the 
characteristic exponent grows linearly with depth. Inter- 
estingly, this exponent has a non-trivial upper bound. 
The in-component size distribution exhibits very similar 
qualitative behaviors. 

The structure of the network changes considerably 
with the depth as nodes that are closer to the root tend 
to have a larger number of connections. Such stratifica- 
tion is empirically observed in complex networks includ- 
ing the internet [1^ , and can be intuitively understood as 
follows. There are strong correlations between the depth 
of a node and its age because young nodes must be less 
connected. Since younger nodes are also further from 
the root, there are correlations between the degree and 
the depth. A natural complementary classification of the 
nodes is by their age, and we anticipate that similarly, 
the degree distribution exhibits age dependence. 

The above results are not limited to trees. This is 
seen from a generalization of the preferential attachment 
process where new nodes attach to two nodes: one target 



6 



node that is selected with probabihty proportional to its 
degree and one, randomly selected, parent of the target 
node. Thus, each new node adds a three-node cycle, 
and the network has at least as many cycles as there are 
nodes. Yet, the governing equations do not change and 
the behavior of the degree distribution and in-component 
size distribution are basically, the same [20]. 

One issue, open to further investigations, is the be- 
havior in finite systems. The analysis in the appendix 
relies on on the continuum approximation. Yet, this ap- 
proximation is asymptotically exact for degrees that are 
much smaller than the maximal one. A discrete approach 
with difference equations, rather than differential ones, is 
necessary [U HM HI] to determine the behavior for the 
degrees that are of the order of the maximal degree. 
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APPENDIX A: FINITE NETWORKS 

Throughout this investigation, we implicitly consid- 
ered the leading asymptotic behavior for large networks. 
In particular, the sub-dominant dependence of the nor- 
malized degree distribution on the size of the network was 
ignored in (jl3p . However, the logarithmic dependencies 
of the average depth and the variance suggest that ex- 
tremely large networks may be needed to clearly observe 
the large- iV asymptotics (|15p . 

To investigate how the degree distribution depends on 



the total number of nodes N, we rewrite the governing 
equation (jl2p in continuum form for large k, 



dF 



1 d 



dN 2N dk 



(kF) = 0. 



(Al) 



In deriving this equation, we omitted the superscript and 

(n) 

the subscript, F = F^ ' . We now include the term 
df /dN describing how the degree distribution changes 
with system size in the evolution equation for the nor- 
malized distribution, defined by F = M f , 

^^M + ^^ + ^^ + ^)^ = °- (^2) 

The normalized depth ^ is y = 2(n — l)/lniV and 
therefore, dy/dN = —y/ {N\nN). We now assume that 
the power-law tail (jlSp is modified by a correction, 
f{k,N) ~ Ak-'-^+y'^u{k,N). From the correction 

function u satisfies 



du In k 

'Ok'^'^^klnN 



u = 



(A3) 
log-normal. 



Therefore, the correction function is 
w = exp[— 2y(lnfc)^/ln7V], and the normalized distribu- 
tion has the following tail 



rin) 
Jk 



Ak- 



exp 



{\nkf 



IniV 



(A4) 



Indeed, the correction is irrelevant for infinitely large net- 
works: u — !■ 1 when N ^ oo. For large but finite systems, 
there are two consequences. First, at moderate degrees, 
the correction is sub-dominant and the tail is power-law, 
although the exponent may appear slightly larger than 
the asymptotic value Second, at large degrees, the 

correction is dominant and the tail is log-normal. 
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